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Focusing,  sustaining,  and  switching  attention 

A.  Scientific  and  Technical  Objectives 

Acoustic  information  is  conveyed  by  changes  in  sound  over  time,  requiring  listeners  to 
sustain  attention  to  understand  acoustic  signals.  Moreover,  sounds  start  and  stop, 
requiring  attention  switching.  To  predict  how  well  humans  can  communicate  in  complex 
acoustic  scenes,  we  must  understand  the  dynamics  of  focusing,  sustaining,  and 
switching  selective  auditory  attention.  However,  most  past  work  has  ignored  attentional 
dynamics.  This  project  used  perceptual  and  computational  experiments  to  explore  the 
dynamics  of  selective  attention. 

Aim  1.  Influence  of  room  acoustics.  Using  behavioral  measures,  we  tested  the 
hypothesis  that  room  reverberation  interferes  with  selective  attention. 

Aim  2.  Effects  on  non-spatial  features.  We  measured  whether  selective  attention  to 
an  ongoing  target  improves  with  time  when  the  target  has  a  contiguous  feature 
distinguishing  if  from  competing  sources. 

Aim  3.  Role  of  visual  cues.  We  explored  how  visual  cues  help  direct  selective  auditory 
attention  through  behavioral  measures  and  computational  modeling. 

Our  results  may  benefit  sailors,  commanders,  and  war  veterans,  many  of  whom  deal 
with  complex  acoustic  scenes  full  of  competing  sources  (where  selective  auditory 
attention  is  challenging  in  the  best  of  circumstances),  and  many  of  whom  also  suffer 
noise-induced  hearing  loss  that  disrupts  selective  auditory  attention. 

B.  Comparison  between  actual  accomplishments  and  goals 

Work  in  the  first  reporting  period  explored  Aim  1.  Our  work  on  Aim  2  was  very 
productive,  and  was  the  main  focus  of  our  efforts  in  years  2-4.  Given  the  advances 
made  in  Aim  2,  we  reduced  efforts  on  Aim  3;  however,  we  undertook  one  auditory-visual 
experiment  to  understand  how  grouping  influences  across-sensory  integration. 

C.  Approach 

Behavioral  experiments  were  conducted  to  explore  the  ability  of  listeners  to  separate, 
understand,  and  identify  messages  from  competing  auditory  streams.  Spatial  cues  and 
other  features  in  the  acoustic  signals  were  manipulated  to  explore  how  the  continuity  of 
the  low-level  acoustic  information  influences  performance  when  listeners  focus  and 
maintain  attention.  In  some  experiments,  multiple  loudspeakers  are  used  to  present 
competing  sounds  from  different  locations.  In  other  experiments,  realistic  spatial  cues 
were  simulated  using  virtual  auditory  space  techniques.  In  selective  attention  tasks, 
listeners  reported  the  identity  or  content  of  one  source  in  the  mixture.  In  segregation 
tasks,  perceptual  organization  of  the  sound  mixture  was  measured  both  directly  and 
indirectly,  by  measuring  the  contributions  of  ambiguous  sound  elements  to  object 
identity  and/or  to  object  location.  These  methods  do  not  deviate  from  those  of  the 
original  proposal. 

C.  Accomplishments 

We  found  that  the  ability  to  focus  attention  degrades  as  reverberant  energy  increases. 
Moreover,  this  degradation  in  selective  attention  is  observed  at  levels  of  reverberation 
too  low  to  interfere  with  speech  intelligibility  directly;  the  disruption  is  in  the  ability  to 
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focus  attention.  This  result  highlights  the  need  to  minimize  reflected  sound  energy  if 
simultaneous  sounds  are  likely  (Aim  1) 

We  found  that  continuity  of  talker  identity  helps  listeners  extract  information  from  an 
ongoing  message.  This  result  shows  that  the  perceptual  benefits  of  spatial  continuity  is 
one  aspect  of  a  more  general  result  (Aim  2). 

We  found  that  the  benefits  of  continuity  of  voice  quality  are  not  due  to  listeners 
volitionally  focusing  attention  on  the  target,  but  are  attributable  to  an  automatic 
enhancement  of  whatever  subsequent  acoustic  signal  is  similar  to  the  acoustic  signal 
currently  in  the  attentional  foreground.  This  result  suggests  that  voice  continuity  effects 
are  strongly  obligatory  and  automatic  (Aim  2). 

Together,  these  results  highlight  the  importance  of  conveying  information  in  a  single, 
continuous  stream  in  order  to  maximize  the  rate  of  communication.  For  instance,  when 
conveying  information  to  a  commander  in  a  time  of  high  communication  volume,  one 
should  combine  messages  into  a  single  continuous  stream,  rather  than  providing 
multiple,  shorter  messages  (Aim  2). 

We  found  that  even  when  there  are  not  competing  sound  streams,  perceptual  continuity 
has  an  influence  on  speech  understanding.  Specifically,  when  the  talker  in  a  sequence 
of  digits  changes  from  digit  to  digit,  forcing  listeners  to  switch  attention  over  time  from 
one  source  to  another,  intelligibility  is  degraded  (Aim  2). 

We  found  that  temporal  gaps  in  ongoing  streams  reduce  the  effects  of  feature 
continuity,  but  that  gaps  as  long  as  600  ms  are  insufficient  to  complete  eliminate  the 
effects  (Aim  2). 

We  found  that  a  well-studied  auditory-visual  illusion,  the  “flash-beep”  illusion,  is 
influenced  by  spatial  cues.  In  the  standard  illusion,  the  number  of  perceived  visual 
flashes  is  strongly  influenced  by  the  number  of  auditory  beeps  presented  at  roughly  the 
same  time.  Here,  we  showed  that  the  influence  of  an  auditory  stream  on  visual 
perception  depends  on  the  difference  in  the  locations  of  the  visual  and  auditory  streams, 
suggesting  that  the  flash-beep  illusion  reflects  integration  of  multisensory  information 
that  is  perceived  as  coming  from  a  single  distal  source  (Aim  3). 

D.  Productivity 
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Shinn-Cunningham  BG  (2013).  “Auditory  attention  (or  how  you  hear  a  voice  inside  your 
head),”  Eastern  Auditory  Retreat,  University  of  Maryland,  15  June  [invited  talk], 
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